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SYSTEM AND METHOD FOR 
PARALLELING DIGITAL WRAPPER DATA STREAMS 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention generally relates to digital wrapper format 
communications and, more particularly, to a system and method for 
multiplexing and demultiplexing parallel digital wrapper data streams, 

2. Description of the Related Art 

Digital wrapper format communications, such as those 
specified in the International Telecommunications Union ITU-T G.709 
(G.709) standard, are used for the high-speed transportation of lower 
hierarchy messages, such as synchronous optical network (SONET) 
messages. Digital wrapper messages are communicated at a wide variety 
of data rates. Obviously, it is desirable to communicate information at the 
highest data rate possible. One key limitation in the digital wrapper data 
rate is the equipment used to process the messages. Digital wrapper 
messages are received at nodes, which include processors. The processor 
performs functions such as decoding the received message, which is 
typically encoded with forward error correction (FEC). The processor can 
use the FEC overhead information to make corrections to the received 
data. The processor can also drop overhead bytes, analyze overhead bytes 
to determine the health of the network, overwrite the overhead with new 
overhead bytes, and encode the message with FEC for transmission. 

However, the performance of the above-mentioned tasks by 
the processor can slow the overall data rate between nodes. Then, the 
data rate of the network must be lowered to accommodate the processors. 
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Alternately, the processors can be designed to be fast enough to 
accomplish all the required tasks without slowing the overall data rate. 
However, extremely fast processors are expensive and consume more 
power to operate. Further, the processor interface devices must be 
5 upgraded to keep pace with the faster processors. 

It would be advantageous if lower speed processors could be 
used in the digital wrapper format communication nodes without lowering 
the overall data rate of the network. 



y 10 SUMMARY OF THE INVENTION 

^ The invention provides for a chip synchronization feature 

where a plurality of digital wrapper processors can be paralleled. An 

If] 

3 example is presented to enable the creation and transport of a 40-gigabit 

i^l per second (Gbs) data stream in a cost effective manner. This is done by 

m 15 using a synchronization architecture applied to four distinct integrated 

S 

circuit devices, each of which carries 10-Gbs digital wrapper data. 
To continue the example, four 10-Gbs digital wrapper 
integrated circuit devices can be paralleled to allow processing of a single 
40-Gbs data stream. The four 10-Gbs digital wrapper integrated circuit 

20 devices each receive a 10-Gbs data stream and an accompanying chip 
synchronization pulse from a single-40 Gbs demultiplexer device. The 
demultiplexer device provides a common clock that it fans out to each of 
the four 10-Gbs digital wrapper integrated circuit devices. Each of the 
four 10-Gbs digital wrapper integrated circuit devices then aligns its 

25 frame boundaries to the incoming chip synchronization pulse, which 

ensures that the frame boundaries on all four 10-gigabit digital wrapper 
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integrated circuit devices will be synchronized. This enables transport of 
all four 10-Gbs digital wrapper data streams, as a single cohesive 40-Gbs 
data stream. Each of the four 10-Gbs digital wrapper integrated circuit 
devices provides a start of frame pulse on its output along with the normal 
5 data. Then, a 40-Gbs multiplexer device uses the start of frame pins to 
align the four 10-Gbs data streams into a single 40-Gbs multiplexed data 
stream. 

Transporting four 10-Gbs digital wrapper data as a single 40- 
Gbs data stream is advantageous because only the multiplexer and 
10 demultiplexer are required to run at the increased data rate, but all the 
processing of the digital wrapper data can be done with 10-Gbs integrated 
circuit devices. This results in greatly increased system efficiency with 
HI only a minimal increase in cost. Further, by synchronizing the 10-Gbs 

M devices with the means described herein, the multiplexer and 

flJ 

15 demultiplexer devices are made at minimum cost since they will not 

13 

f5 require much, if any, deskewing functionality. 

Accordingly, a system is provided for paralleling data 
streams in a G.709 network of connected integrated circuits. The system 
comprises a demultiplexer for receiving a first digital wrapper data 
20 stream having a first data rate. The demultiplexer demultiplexes the first 
data stream into a plurality of digital wrapper data streams having a 
second data rate, less than the first data rate. 

The system also comprises a plurality of processors. Each 
processor accepts a corresponding one of the plurality of data streams and 
25 supplies a processed data stream at the second data rate. A multiplexer 
receives the plurality of processed data streams and multiplexes the 
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plurality of processed data streams into a first digital wrapper processed 
data stream having the first data rate for transmission. 

The demultiplexer also supplies a synchronization signal 
with each of the second plvirality of data streams, responsive to overhead 
5 bytes in the first data stream. More specifically, the demultiplexer 

receives frame alignment signal bytes in the overhead of every first data 
stream frame and synchronizes frame alignment signal bytes in each of 
the plurality of data streams to the frame alignment signal bytes in the 
first data stream. Each processor processes one of the plurality of data 

10 streams in response to receiving its corresponding synchronization signal. 

Each processor supplies a frame start signal corresponding to 
its processed data stream. The multiplexer receives the frame start 
signals and multiplexes each of the plurality of processed data streams 
into the first processed data stream in response to the plurality of received 

15 frame start signals. More specifically, the multiplexer synchronizes frame 
alignment signal bytes in the first processed data stream to each of the 
frame alignment signal bytes in the plurality of processed data streams. 
In some aspects of the system, the multiplexer phase matches the frame 
start signals and deskews the plxirality of processed data streams to 

20 match their corresponding frame start signals. 

Additional details of the above-described system, and a 
method for paralleling data streams in a G.709 network of connected 
integrated circuits are provided below. 



applied_107 



-5" 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic block diagram of the present invention 
system for paralleling data streams in a G.709 network of connected 
integrated circuits. 

Figs. 2a and 2b depict a digital wrapper framing structure. 

Fig. 3 is a diagram illustrating the G.709 optical data unit 
(ODU) frame structure, and the ODU overhead, optical channel payload 
unit (GPU), and optical channel transport unit (OTU) overhead. 

Fig. 4 is a depiction of the deskewing function carried out by 
the multiplexer of Fig. 1. 

Fig. 5 is a flowchart illustrating the present invention 
method for paralleling data streams in a G.709 network of connected 
integrated circuits. 

Fig, 6 is a flowchart illustrating an aspect of the present 
invention method for paralleling data streams of Fig. 5. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Fig. 1 is a schematic block diagram of the present invention 
system for paralleling data streams in a G.709 network of connected 
integrated circuits. The system 100 comprises a demultiplexer 102 with 
an input on line 104 for receiving a first digital wrapper data stream 
having a first data rate. As shown, the data rate is approximately 40- 
gigabits per second (Gbs), however, the system 100 is not limited to any 
particular data rate. The demultiplexer 102 demultiplexes, or splits the 
first data stream into a second plurality of digital wrapper data streams 
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having a second data rate, less than the first data rate, supplied at an 
output on lines 106, 108, 110, and 112. As shown, the second plurality is 
equal to four, but this is merely exemplary. The present invention is not 
limited to any particular demultiplexing ratio. 

The system 100 further comprises a second plurality of 
processors. Shown are processors A through D (114, 116, 118, and 120, 
respectively). Each processor has an input to accept a corresponding one 
of the second plurality of data streams. That is, processor A (114) has an 
input on line 106, processor B (116) has an input on line 108, processor C 
(118) has an input on line 110, and processor D (120) has an input on Une 
112. Each processor A through D (114-120) has an output to supply a 
processed data stream at the second data rate. Processor A (114) has an 
output on line 122, processor B (116) has an output on line 124, processor 
C (118) has an output on line 126, and processor D (120) has an output on 
line 128. 

The system 100 also comprises a multiplexer 130 having an 
input to receive the second plurality of processed data streams on lines 
122-128. The multiplexer midtiplexes, or combines the second plurality of 
processed data streams into a first digital wrapper processed data stream 
having the first data rate, supplied at an output on line 132 for 
transmission. 

Figs. 2a and 2b depict a digital wrapper framing structure. 
Each frame is composed of a set of rows. As shown, each fi'ame includes 
four rows. In the notation of the above-described system, each frame 
comprises a second plxirality of rows. Each processor operates on a data 
stream having a fi'ame structure similar to the frame structures of Figs. 
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2a and 2b. Each processor operates on a frame structure having frame 
alignment signal bytes. 

Fig. 3 is a diagram illustrating the G.709 optical data unit 
(ODU) frame structure, and the ODU overhead, optical channel payload 
5 unit (OPU), and optical channel transport unit (OTU) overhead. In a 

G.709 compliant system, it is normal to provide read access to all 64 of the 
G.709 overhead bytes by dropping them to the user interface during each 
frame. Some of these 64 overhead bytes contain frame alignment signal 
(FAS) bytes. As shown, the frame alignment signal bytes are in row 1, 

10 columns 1 through 6. The frame alignment signal bytes contain no 

information per se, but are used as a marker to indicate the beginning of a 
frame, or a row. That is, the frame alignment signal bytes are used for 
frame synchronization and timing. 

Returning to Fig. 1, the demultiplexer 102 receives first data 

15 stream messages in a frame format with overhead bytes, for example the 
overhead bytes in Fig. 2b, and supplies the second plurality of data stream 
messages in a frame format with overhead bytes. That is, the 
demultiplexer 102 demultiplexes the frame into four unique frames 
corresponding to the four data streams. More specifically, the 

20 demultiplexer 102 deinterleaves a unique digital wrapper frame structure 
that is used for the transport of lower hierarchy OTU frames. This 
transport frame structure closely resembles a conventional OTU frame. 
This digital wrapper transport frame is deinterleaved into a second 
plurality of actual OTU frames that can be processed by conventional 

25 processors. For example, the first data stream may be a combination of 4 
different 0TU2 (10-Gbs) streams interleaved into a 40-Gbs digital 
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wrapper frame that resembles an 0TU3 (40-Gbs frame). For every frame 
received by the demultiplexer 102 in the first data stream, the 
demultiplexer 102 supplies a first frame on line 106, a second frame on 
line 108, a third frame on line 110, and a fourth frame on line 112. 
5 It should also be understood that there is a fixed relationship 

between the first data rate, the second data, and the second plurality of 
processors. That is, the second data rate is equal to the first data rate 
divided by the number of processors. Since the first data rate is 
approximately 40-Gbs and four processors are shown, the data rate on 

10 lines 106, 108, 110, and 112 (as well as lines 122, 124, 126, and 128) is 
approximately 10-Gbs. The exact data rates are stated as approximate, 
since the rate is affected by a number of different factors in the system 
and the specific formatting standards in use. 

The demultiplexer 102 has an output to supply a 

15 synchronization signal on fines 134, 136, 138, and 140 with each of the 

second plurality of data streams 106, 108, 110, and 112, respectively. The 
synchronization signals are responsive to overhead bytes in the first data 
stream on line 104. Each processor has an input to receive a 
synchronization signal. Each processor processes one of the second 

20 plurality of data streams in response to its corresponding synchronization 
signal. That is, processor A (114) processes the data stream on line 106 in 
response to the synchronization signal on line 134. Likewise, processor B 
(116) processes the data stream on line 108 in response to the 
synchronization signal on fine 136, processor C (118) processes the data 

25 stream on line 110 in response to the synchronization signal on line 138, 
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and processor D (120) processes the data stream on line 112 in response to 
the synchronization signal on line 140. 

It is possible to provide synchronization timing with respect 
to a number of different bytes, or byte positions in the frame. One useful 
synchronization method is for the demultiplexer to send synchronization 
signals that have a predetermined relationship to the FAS bytes in the 
first data stream frame and the FAS bytes of each frame in each of the 
second plurality of data streams. 

The demultiplexer 102 synchronizes overhead bytes in each 
of the second plurality of data streams on lines 106-112 to overhead bytes 
in the first data stream on line 104. More specifically, the demultiplexer 
102 receives frame alignment signal bytes in the overhead of every first 
data stream frame and synchronizes frame alignment signal bytes in each 
of the second plurality of data streams to the frame alignment signal 
bytes in the first data stream. The OTU frame structure of the frames in 
the second plurality of data streams, with FAS bytes, are explicitly shown 
in Fig. 3. The digital wrapper frame of the first data stream, although 
slightly different from a OTU frame, includes FAS bytes. The FAS bytes 
in the first data stream digital frame structure have a predetermined 
relationship in the frame structure, although the position need not be 
identical to the FAS byte positions in the OTU frames. 

Likewise, each of the second plurality of processors 114-120 
supplies a processed data stream message in a frame format with 
overhead bytes. As mentioned above in the Background, the processors 
114-120 may perform a variety of communication functions, such as 
dropping and adding overhead bytes, as well as FEC decoding and 
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encoding. The multiplexer 130 transmits the first processed data stream 
messages on Kne 132 in a frame format with overhead bytes. Each 
processor 114-120 has an output to supply a frame start signal on lines 
142, 144, 146, and 148, corresponding to processed data streams on lines 
5 122, 124, 126, and 128, respectively. The multiplexer 130 has an input to 
receive the frame start signals on lines 142 through 148 and multiplexes 
each of the second plurality of processed data streams on lines 122 
through 128 into the first processed data stream on line 132, in response 
to the second plurality of received frame start signals on lines 142 through 

U 10 148. The multiplexer 130 synchronizes overhead bytes in the first 

processed data stream to the overhead bytes in the second plurality of 

fff processed data streams using the frame start signals. 

U1 More specifically, the second plurality of processors 114-120 

M supply frame alignment signal bytes in the overhead of every frame (see 

m 

y, 15 Fig. 3) in the second plurality of processed data streams on lines 122-128. 

pi The multiplexer 130 synchronizes frame alignment signal bytes in the 

first processed data stream on line 132 to each of the frame alignment 
signal bytes in the second plurality of processed data streams on lines 
122-128. Alternately stated, the synchronization and multiplexing 
20 operations are performed using the known position of the FAS bytes in the 
OTU frames in the second plurality of processed data streams and the 
FAS bytes in the first processed data stream digital wrapper frame 
structure. The multiplexer 130 interleaves the frames in the second 
plurality of processed data streams into a frame in the processed first data 
25 stream. 
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Fig. 4 is a depiction of the deskewing function carried out by 
the multiplexer 130 of Fig. 1. Due to variations in processor functions, or 
variations in the clocks operating the processors, or transmission line 
delays, the second plurality of processed data streams do not necessarily 
5 arrive at the multiplexer at the same time. To recombine the second 
plurality of frames, properly deskewing and synchronization operations 
must occur. The multiplexer 130 compares each of the second plurality of 
received frame start signals, and phase matches the frame start signals. 
The phase matching can occur by delaying the earlier arriving signals to 
10 match the later arriving signals. The frame start signals are indicators of 
the timing of the associated processed data streams. More specifically, 
the relationship between the frame start signal and the frame alignment 
signal bytes in the associated processed data stream is known. Once the 
frame start signals are matched, the same matching operations can be 
15 applied to the processed data streams. That is, the second plurality of 
W processed data streams are deskewed to match their corresponding phase 

matched frame start signals. Once deskewed, the processed data streams 
are easily multiplexed. Alternately stated, the frame start signals have a 
predetermined relationship to the FAS bytes of the frames in the second 
20 plurality of processed data streams. Once deskewed, the FAS bytes of the 
frames in the second plurality of processed data streams have a fixed 
relationship to the FAS bytes in the interleaved frame of the first 
processed data stream. 

Fig. 5 is a flowchart illustrating the present invention 
25 method for paralleling data streams in a G.709 network of connected 

integrated circuits. Although the method (and the method of Fig. 6 below) 
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is depicted as a sequence of numbered steps for clarity, no order should be 
inferred from the numbering unless explicitly stated. The method starts 
at Step 500. Step 502 receives a first digital wrapper data stream having 
a first data rate. Step 504 demxiltiplexes the first data stream into a 
second plurality of digital wrapper data streams having a second data 
rate, less than the first data rate. In some aspects, demultiplexing the 
first data stream into a second plurality of digital wrapper data streams 
includes demiiltiplexing into four data streams. Step 506 processes the 
second plurality of data streams at the second data rate. Step 508, 
following the processing of the second plurality of data streams, supplies a 
second plurality of processed data streams having the second data rate. 
Step 510 multiplexes the second plurality of data streams into a first 
processed data stream having the first data rate. Step 512 transmits the 
first processed data stream. 

In some aspects, receiving a first digital wrapper data stream 
having a first data rate in Step 502 includes receiving the first data 
stream at approximately 40-gigabits per second data rate. 
Demultiplexing the first data stream into a second plurality of digital 
wrapper data streams having a second data rate, less than the first data 
rate, in Step 504 includes demultiplexing the approximately 40-gigabits 
per second data stream into 4 data streams having approximately a 10- 
gigabits per second rate. 

Receiving a first digital wrapper data stream having a first 
data rate in Step 502 includes receiving messages in a frame format with 
overhead bytes. Then, demultiplexing the first data stream into a second 
plurality of digital wrapper data streams having a second data rate in 



applied 107 

-13- 

Step 504 includes supplying a second plurality of messages in a frame 
format with overhead bjrtes. Further, demultiplexing the first data 
stream into a second plurality of digital wrapper data streams having a 
second data rate includes supplying a synchronization signal with each of 
5 the second plurality of data streams responsive to overhead bytes in the 
first data stream. In some aspects of the method, supplying a 
synchronization signal with each of the second plurality of data streams 
responsive to overhead bytes in the first data stream in Step 504 includes 
synchronizing overhead bytes in the second plurality of data streams to 

10 overhead bytes in the first data stream. Then, processing the second 
plurality of data streams at the second rate in Step 506 includes 
processing each of the second plurality of data streams in response to its 
corresponding synchronization signal. 

In some aspects, receiving messages in a frame format with 

15 overhead bytes in Step 502 includes receiving fi:ame alignment signal 
bytes in the overhead of every frame. Synchronizing overhead bytes in 
the second plurality of data streams to overhead bytes in the first data 
stream in Step 504 includes synchronizing fcame alignment signal bytes 
in each of the second plurality of data streams to the frame alignment 

20 signal bytes in the first data stream. 

In some aspects of the method, supplying a second plurality 
of processed data streams in Step 508 includes supplying messages in a 
frame format with overhead bytes. Then, transmitting the first processed 
data stream in Step 512 includes transmitting messages in a frame format 

25 with overhead bytes. 
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In some aspects, supplying a second plurality of processed 
data streams in Step 508 includes supplying a frame start signal with 
each of the second plurality of processed data streams. Then, 
multiplexing the second plurality of processed data streams into the first 
5 processed data stream in Step 510 includes multiplexing in response to 
the second plurality of frame start signals. Further, multiplexing the 
second pluraUty of processed data streams into the first processed data 
stream includes synchronizing overhead bytes in the first processed data 
stream to the overhead bytes in the second plurality of processed data 

10 streams in response to the frame start signals. 

In some aspects of the method, supplying a second plurality 
of processed data stream messages in a fi:*ame format with overhead bytes 
in Step 508 includes supplying frame alignment signal bytes in the 
overhead of every frame. Synchronizing overhead bytes in the first 

15 processed data stream to overhead bytes in the second plurality of 
processed data streams in Step 510 includes synchronizing frame 
alignment signal bj^es in the first processed data stream to fi^ame 
ahgnment signal bytes in each of the second plurality of processed data 
streams. 

20 Some aspects of the method included further steps. Step 

509a, following the supplying of the second plurality of processed data 
streams, compares each of the second plurality of processed data stream 
frame start signals. Step 509b phase matches the second plurality of 
frame start signals. Step 509c deskews the second plurality of processed 

25 data streams to match their corresponding frame start signals (after 
phase matching). Then, multiplexing the second plurality of processed 
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data streams into the first processed data stream in Step 510 includes 
multiplexing the deskewed second plurality of processed data streams. 

Fig. 6 is a flowchart illustrating an aspect of the present 
invention method for paralleling data streams of Fig. 5. The method 
5 starts at Step 600. Step 602 processes a second plurality of (parallel) data 
streams at a second rate. Step 604 supplies a second plurality of 
processed data streams having the second data rate. Step 606 multiplexes 
the second plurality of processed data streams into a first processed data 
stream having the first data rate, greater than the second rate. Step 608 
P 10 transmits the first processed data stream. 

W A system and method have been provided for paralleling 

m digital wrapper format data streams. Specific examples have been 

If] provided in the context of the G.709 standard. In addition, specific data 

M rates and fi:ame structures have been mentioned. However, the present 

'y, 15 invention is not limited to any particular data rate, multiplexing ratio, or 

a 

firame structure. Other variations and embodiments of the invention will 
^ occxir to those skilled in the art. 

WE CLAIM: 



20 



